Work probability distribution and tossing a biased coin 
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We show that the rare events present in dissipated work that enters Jarzynski equality, when 
mapped appropriately to the phenomenon of large deviations found in a biased coin toss, are enough 
to yield a quantitative work probability distribution for Jarzynski equality. This allows us to propose 
a recipe for constructing work probability distribution independent of the details of any relevant 
system. The underlying framework, developed herein, is expected to be of use in modelling other 
physical phenomena where rare events play an important role. 
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I. INTRODUCTION 

Large deviations play a significant role in non- 
equilibrium statistical physics [Trial. They arc difficult 
to handle because their effects though small, are not 
amenable to perturbation theory. All the conventional 
perturbation theories in statistical physics are fashioned 
about a Gaussian distribution, which almost by defini- 
tion, is the distribution with no large deviations. This 
can be seen in static critical phenomena, critical dynam- 
ics, dynamics of intcrfacial growth, statistics of polymer 
chain and myriad other problems 7]. Our contention is: 
in the large deviation theory [8l4ll|. the central role is 
played by the distribution associated with tossing of a 
coin and the simple coin toss is the "Gaussian model" of 
problems where rare events play significant role. In this 
paper, we illustrate our contention by applying it to the 
study of some aspects of Jarzynski equality. 
Fluctuation theorems form a very important part of 
nonequilibrium statistical mechanics |L2Hl9l j. There has 
been a lot of activity in the last decade or so and var- 
ious forms of such theorems has been established. One 
particular form is Jarzynski equality [3, [l5| . If W is the 
work done during a period of duration r, during which 
an external force acts on the system and does work, then 
Jarzynski established that in units of KbT 
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where angular brackets denote ensemble average and AF 
is the free energy difference for the equilibrium free en- 
ergies corresponding to the initial and final states. Here 
Kb is Boltzmann constant and T is the temperature of 
the concerned system in the initial equilibrium state or, 
equivalently, the temperature of the heat reservoir with 
which the system was thermalizcd before the process took 
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place. It is important to note that here W is a path (tra- 
jectory followed by the system during r) dependent vari- 
able. So, if we consider the ensemble of all possible paths 
(each path originating from one of the several microstates 
corresponding to the initial equilibrium macrostate) , dif- 
ferent values of W along different path can be identified 
with a set of random variable. Now, if we define another 
random variable — dissipative work along a path — as 



W D ee W - AF 
Jarzynski equality ((T|) shows that 



( e -w D \ = 1 



(2) 
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Clearly, to satisfy above equality, Wo should take both 
positive and negative values. Again, we know that since 
(W) is the thermodynamic work done in going from ini- 
tial state to the final state, the second law of thermody- 
namics would assert that (W) > AF (i.e., (Wd) > 0), 
with the equality holding for the reversible process where 
the system remains always in the equilibrium with its 
surrounding. So, negative values of Wd are relatively 
rare events, yet important enough to make the equality 
of Eq.© to hold. 



II. THE STRATEGY 

The strategy for demonstrating the validity of our 
approach will be as follows. As the paradigm for the 
distribution of rare events we will take, as mentioned 
earlier, the distribution associated with tossing a coin. 
The random variable associated with a coin toss can 
range between two finite numbers which we will take 
to be and 1. (It'll be explained in details in the 
next section.) The mean value p, of the variable for an 
unbiased coin is 1/2 and for a biased coin it lies between 
and 1 but p ^ 1/2. Dissipative work along a path 
Wd ranges from — oo to +oo and we will first carry out 
a transformation that maps it onto the range to 1. 
Further, according to the second law of thermodynamics, 



2 



the events corresponding to W > AF (or, Wd > 0) are 
more likely than the ones corresponding to W < AF 
(or, Wd < 0) and hence there will be an asymmetry 
or bias about the events corresponding to W = AF 
(or, Wd = 0). The amount of bias in the statistics of 
W due to irreversibility is clearly: (W) — AF. The 
corresponding coin has to be biased as well and hence we 
shall take the asymmetric situation of p ^ 1/2. Needless 
to say that for reversible process, since (W) — AF, this 
bias is zero. Having defined the mapping — which, 
of course, is not unique — the first check would be 
to verify if Jarzynski equality in the form of Q is 
satisfied. This can be tested since we have an explicit 
distribution — namely, the one associated with the 
biased coin toss. Such a check is depicted in figure 
(1), details regarding which follows later in this paper. 
From the distribution for Wd one can also have the 
distribution for W. The distributions of work and 
dissipative work have drawn a lot of attraction. For 
various systems these distributions are now known from 
experiments as well as numerical studies (e.g. (20l - [27| ). 
Here we obtain these distributions from very general 
requirements, which are independent of the dynamics 
(that usually varies from system to system) followed 
by the systems. Hence it is important to ask whether 
the experiments on the systems obeying widely different 
dynamics really exhibit similar distributions. We find 
the answer here by comparing our results with actual 
experimental results and numerical simulations. The 
probability distribution for Wd, P(Wp), was obtained 
experimentally by Liphardt et al. [2J|; and, P(W) has 
been obtained by Blickle et al. [25| for a different system. 
We have also used an anharmonic oscillator driven by 
a linear time dependent force to simulate the dynamics 
and numerically construct P(W) [26j |. A similar system 
has also been studied in 12711 . 



In this work, we calculate P(W) from the biased coin 
toss distribution which we have taken as a starting ansatz 
based on the principle of large deviations. The only con- 
nection between the experiments and the method we use, 
is the fact that, the experiment is carried out far from 
equilibrium and hence must feature negative values of 
Wd (large deviations) and we have started with a dis- 
tribution which has large deviations built in it. As will 
turn out, our method will have two parameters which 
we fix by comparing with the distribution obtained from 
the experiment. The appropriateness of P(W), we cal- 
culate employing the theory of large deviations, is borne 
out by comparison as well be demonstrated below. The 
point we want to stress here is that the present theory, 
which explicitly takes care of large deviations, does not 
require explicit knowledge of dynamics. Consequently, it 
has wide range of applicability. The parameters of the 
distribution need to be fixed in each case from the scales 
of measured distribution — e.g., peak position and peak 
magnitude. 



III. COIN TOSS 

We begin by recalling the situation of coin tossing ex- 
periment. If we assign a value 1 to the outcome 'heads' 
and to the outcome 'tails', then the mean after A trials 
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This is an experimental mean which belongs to a set of 
independent and identically distributed (i.i.d) random 
numbers lying between and 1 since each individual Aj 
is either or 1 . For an unbiased coin where "heads" and 
"tails" are equally probable, this mean goes towards 1/2 
as A — > oo. However, for a biased coin where the prob- 
ability of obtaining "heads" is p(^ 1/2), the mean will 
converge towards p as A — > oo. If in A trials 'heads' 
appear A times, then the probability of finding a mean 
M N = A/A is 
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This is the binomial distribution, which is the most 
commonly used example of a theory exhibiting large 
deviations i.e. even when A 3> 1, we find a P 
which falls off slower than Gaussian. P (A/A) ~ 
cxp[-A (A/A - pf/a 2 }. Taking log of both side of eq. 
(J5]), we arrive at: 
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We know from Stirling's formula that for large A, A! ~ 
jy-N e -N \/2tiN . Applying Stirling's approximation for 
large A, A, (A — A), the above relation becomes 



lnP(x) = -NJ(x), 



(7) 



where, 
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and x = X/N. This leads to 
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where, 
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For large enough A the pre-factor changes slowly com- 
pared to the exponential term and we get Chernoff 's for- 
mula where I(x) is the rate function. 



IV. THE MAPPING 



In order to appreciate the analogy between the large 
deviation theory and the Jarzynski equality, we need to 
consider evolution of a relevant system to have a stochas- 
tic component, i.e. there is a regular time dependent 
force acting on the system from t = to t = r as it 
proceeds from an initial equilibrium state to a final state 
and in addition there is a random component. Langevin 
dynamics of a particle of mass m can be considered as a 
simple example of such a stochastic dynamics: 
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(11) 



where V is a potential function, f(t) is a regular time de- 
pendent force, A is damping coefficient and rj(t) is random 
noise. Here dots represent time derivative. Fluctuation 
theorems were proven for such a system by Kurchan [28[ 
and subsequently by several authors (29M3^ |. The time 
dependent force is switched on at t = and switched 
off at t = t. At t = Q the system resides in a macro- 
scopic equilibrium state, corresponding to which there 
exist a large number of microstates. Since we are con- 
sidering stochastic evolution, we can start from the same 
microstate and do the experiment N times, each time 
getting different value of the dissipative work. If w l D is 
the dissipative work for i th realisation then we can define 
Wd [the analogue of Mn is Eq.(jH)] as 
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The distribution of Wd is sought from the large deviation 
principle. 

We now note that (W) > AF (or, (W D ) > 0) accord- 
ing to the second law of thermodynamics — the equality 
holds for reversible processes. To implement our scheme, 
we need to define a transformation which maps Wd to 
another variable Z such that, < Z < 1, in accordance 
with the experimental mean in coin toss scenario, given 
in Eq.((3]). We consider the variable Wd + c, where 'c' is 
a quantity that we shall fix later. The class of transfor- 
mation we consider here is 



Z(W D ) = -[l 



tanha(I4^£) + c)], 



(13) 



where 'a' is a parameter which eventually will have to 
be fixed using experimental results. Actually, only the 
positive constant 'a' defines this class of transformations 
because a constraining relation for c will be established. 
Our ansatz is that, Z, like Wd, satisfies large deviation 
principle and the rate function for the coin toss problem 
is the rate function for Z. So, the rate function for Z is 



I(Z) = Zln| + (l-Z)lni-|. 
The probability distribution for Z is simply 
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FIG. 1: In this figure we show the convergence of (exp( — Wd)) 
with respect to N for different values of a. The thick- 
dotted, dot-dashed, and dashed lines are respectively for 
a — 0.17,0.57,0.96. The curves in the figure are obtained 
by numerically integrating equation (1161) by employing Simp- 
son's one-third rule. 



where N is the number of trajectories used in construct- 
ing the experimental mean of the i.i.d variables. In 
our case, Xi in coin tossing experiment and dissipative 
work w D in Eq. (TT2l are i.i.d variables. We note that 
I(Z = 1) = ln(l/p), while I(Z = 0) = ln[l/(l - p)]. For 
p < 1/2, I[Z = 0) < I(Z = 1). The function I(Z) has 
a minimum at Z = p. Thus the probability P(Z) has 
a peak at Z — p and is exponentially small at Z = 
and Z = I, but with P(Z = 0) > P(Z = 1), because 
of the inequality in I(Z). From second law of thermo- 
dynamics, we need (Wd) > for irreversible process, 
i.e. realizations with the outcome Wd > is more prob- 
able than that of Wd < 0. All the above constraints 
are met since Z —> as Wd —> oo and Z — > 1 as 
Wd —> —oo. We now return to Eq. ([l~3"]k noting that 
e ~w D = e c [Z/{l - Z)} 1/2a , we have 



(e- w °) 
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P(Z)dZ 



IoP(Z)dZ 



(16) 



The right hand side of equation (1161) is plotted as a func- 
tion of N in figure (1) for different values of a. As 
N —> oo, we find (e~ WD ) converges to unity for all a, 
as it should according to Jarzynski equality. From fig- 
ure (1) one can see that as a decreases, lesser number of 
trajectories (or, realizations) are required for the conver- 
gence. The convergence is verified for various values of 
p. The result shown in figure (1) is for p = 0.25. 



V. COMPARISION WITH EXPERIMENTS 

We will now obtain P(W) from P{Wd) following the 
theoretical technique discussed above and compare with 
the work distribution function obtained experimentally 
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and numerically. From eq. (|13p we write 
W — AF — c 



2a Z 



We fix c = AF to get the following simple form 

Z 



W = — In 

2a Z 



(17) 



(18) 



We can now find P(W) by noting the normalisation con- 
dition: 
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= f(W)) 



dZ 



dW 



dW = 1 (19) 



where, P{Z) is given in Eq. (|15p . The work distribution 
is then found as 



P(W) = P(Z = f(W)) 



dZ 



dW 



(20) 



with f(W) = (1 - tanhaIV)/2 and P(Z) as given by 
Eq. flTSl) . The parameter N in Eq. (fT5")) can be linked to the 
width a of the distribution by appealing to the Gaussian 
limit which shows that a 1 — 2p(l —p)/N. In principle 
we need to fix three unknown parameters in Eq. (|20j) . viz., 
a, a and p. To reduce the task of parameter-adjustments, 
we pre- assign a value of p. As a result, only a and a will 
be used as fitting parameters. 

We now show the comparison between our assertion of 
the form of P(Wd) [and hence P(IV)] and different ex- 
perimental and numerical results. 



A. Experiment by Liphardt et al. 

This experiment tests Jarzynski equality by streching 
a single RNA molecule between two conformations - 
both reversibly and irreversibly. The experiment has 
been done for three different molecular end-to-end ex- 
tensions and for each extension, three different streching 
rates are considered. For all combinations of extensions 
and pulling rates, the experiment provides P(Wd). For 
the present purpose, we consider three distributions cor- 
responding to 15 nm extension, which are shown in figure 
(2a). Other distributions can also be taken care of simi- 
larly. In this work, P(Wd) we compute, depends on two 
parameters viz., a and a. We determine these two param- 
eters by comparing with P(0) and PmaxiWo) [maximum 
value of P(Wd)] of the corresponding distribution given 
by Liphardt et al. After fixing these two parameters 
as (a, a) ~ (0.12, 0.07), (0.12, 0.13), (0.14, 0.20) for three 
different pulling rates, we arrive at the full distributions 
for every pulling rate. This is shown in figure (2b). We 
fix p = 0.48 here. 



B. Experiment by Blickle et al. 

This experiment deals with the thermodynamics of an 
overdamped colloidal particle in a time dependent non- 
harmonic potential. Blickle et al. have not only measured 
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FIG. 2: (Colour online) The figure of the inset is taken from 
[2~j ] where dissipated work probability distributions are ex- 
perimentally obtained for a particular end-to-end extension 
(= 15nm) of P5abc RNA molecule but for three different 
pulling rates indicated by three different curves — dashed, 
solid and dotted. In main figure we obtain P(Wd) by fixing 
a and a, as required by the theory presented here. 



P(W), they have also computed P(W) from the relevant 
Fokker-Planck dynamics. Our explanation of their P(W) 
is dependent on the choice of the two parameters a and a. 
We determine these parameters by comparing P(0) and 
Pmax(W). This fixes a ~ 0.1 and a ~ 0.2. This compari- 
son is shown in figure (3a) and (3b). We fixp = 0.24 here. 
The moments found by Blickle et al. and us compare as 
follows (Table I) 



Moments 


Values from experiment 


Values from the 




by Blickle et al. 


theory presented here 


(W) 


2.4 


2.40 


(W 2 ) 


11.6 


11.74 


{W 6 } 


63.7 


64.11 



Since we use only two parameters (a and a) to get 
the distribution, it implies that only (W) and (W 2 ) have 
been used. This leaves the (IV 3 ) as a prediction which 
can be compared with the experimental data. A more 
sensitive quantity to measure asymmetry of a distribu- 
tion is (AIV 3 ), where AW = IV- (IV). Our distribution 
shows that this moment is nonzero. If p ^ 1/2, then 
|(AIV 3 )|/((t|1 - 2p|(AIV 2 ) 3 / 2 ) is a constant, the value of 
which in our case is 10. Nonzero (AIV 3 ) corresponds to 
asymmetry of P(W) that has been observed whenever 
the dynamics has been nonlinear (2?j \2l\. In those cases 
the cause of the asymmetry is the strength of the non- 
linear term. Here the role is played by (1 — 2p) (though, 
no particular dynamics is explicitly involved here) and it 
can be considered as a measure of asymmetry. 




FIG. 3: (Colour online) The figure of the inset is taken 
from [25|], which shows experimentally as well as numerically 
obtained work probability distribution function for an over- 
damped colloidal particle in a time-dependent nonharmonic 
potential. In the main figure we obtain P(W) from the theory 
presented here. 



Driven anharmonic oscillator 




FIG. 4: (Colour online) In this figure we show how P(W), 
calculated by simulating the dynamics of a driven Brownian 
particle obeying Eq. (|2Hl (shown in red dots) collapses to the 
P(W) calculated from the distribution for tossing a biased 
coin (shown in black solid line), as it is prescribed here. For 
simulating the dynamics we take fc = l,T=l,A = l and 
7 = 0.1. 



We consider here a Brownian particle, trapped by the 
potential V(x) = kx 2 + 7a; 4 (where k and 7 are con- 
stants) and driven by a linearly time-dependent force 
f(t). The evolution is taken to be governed by follow- 
ing overdamped Langevin dynamics, 

\i+^ = f(t)+ V (t). (21) 

Here r)(t) is the random noise coming from heat bath. We 
assume (rj(t)) = and (rj(t)-q(t')) = 2T\S(t - t'), where 
T is temperature of the bath. The force f(t) acts from 
t = to t = t and P(W) (where W = - f(t)x(t)dt) is 
numerically obtained. The comparison between numer- 
ically obtained P(W) and that obtained from Eq. ([2H|) 
with a ~ 0.15 and a ~ 0.062 is shown in figure (4). We 
fix p = 0.28 here. 



VI. CONCLUSIONS 

In conclusion, we re-stress that the discussed frame- 
work is very general and simple because we require only 
few parameters from experiments and elementary results 
from large deviation theory to construct a full work prob- 
ability distribution, bypassing the 'nitty-gritty' of dy- 
namics. We believe that it is possible to make better con- 
tact with experiments by constructing more appropriate 
form for the function Z. Readers would also appreciate 
that we could derive results concerning Jarzynski equality 
merely by focusing on the rare events — rare negative dis- 
sipation — that enter into Jarzynski equality and map- 
ping them onto the biased coin-toss-experiments. Here 



we have discussed situations where the evolution had a 
stochastic component in addition to the regular time de- 
pendent force. We hope to extend it to the deterministic 
situations. In the deterministic case, we envisage the 
following picture. The evolution of a nonlinear system 
under time dependent drive is intrinsically chaotic and 
we can exploit that to define an "experimental mean" 
for w l D . In this case, we need to consider the different 
initial conditions around an e-neighbourhood (e — > 0) of 
a given microstate and since the evolution of each initial 
microstate (from same initial macrostate) will be differ- 
ent from each other due to the chaotic flow, we can define 
Wd as in Eq. (fT2"|) . Therefore, in accordance with our con- 
tention that the simple coin toss is the 'Gaussian model' 
for the problems where rare events play significant role, 
one might speculate that the phenomenon of intermit- 
tency (and hence multifractality) in fluid turbulence can 
be obtained by treating rare events in the energy dissipa- 
tion rate in the similar fashion outlined in this paper. As 
we have reported elsewhere [33j that, for fluid turbulence, 
the rare events present in the distribution of energy in 
the real space, when mapped appropriately on the phe- 
nomenon of large deviations found in simple coin toss are 
enough to yield anomalous exponents which are known 
to be the signatures of multifractality in fluid turbulence. 
Within this very framework, we hope to model various 
other physical phenomena where rare events play a sig- 
nificant role; after all, now we have a working approach 
to arrive at quantitative results for such processes that 
cannot be usually solved otherwise. 
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